2024-07-24 15:16:47,634 INFO     Table 3
                          Model                  MCC    F1    Accuracy    Sweep Time    Hardware
------------------------  -------------------  -----  ----  ----------  ------------  ----------
Bag-of-Words Classifiers  Logistic Regression   0.51  0.67        0.77         1.53s         CPU
                          Random Forest         0.49  0.62        0.76     2 min. 2s         CPU
                          SVM                   0.49  0.68        0.76         37.8s         CPU
    Language Models       RoBERTa                0.6  0.75        0.81        46 min         GPU
                          BERTweet              0.63  0.77        0.83        44 min         GPU
                          PoliBERTweet          0.68   0.8        0.85        42 min         GPU
2024-07-24 15:16:47,652 INFO     Table 4
Model              MCC    F1    Accuracy    Inference Time (GPU)    Inference Time (CPU)
---------------  -----  ----  ----------  ----------------------  ----------------------
DeBERTaV3 Small   0.15  0.17        0.56                   3.06s              2 min. 37s
DeBERTaV3 Base     0.4  0.69         0.7                   4.98s               5 min. 8s
DeBERTaV3 Large   0.65  0.82        0.83                   13.5s             16 min. 35s
2024-07-24 15:16:47,687 INFO     Table 5
     Prompt       Model            MCC    F1    Accuracy    Inference Time (GPU)    Cost
----------------  -------------  -----  ----  ----------  ----------------------  ------
    Standard      GPT-4           0.78  0.88        0.89                       -  $12.52
                  GPT-3.5 Turbo   0.58  0.73        0.78                       -   $0.68
                  Mistral 7B      0.56  0.72        0.78              2 min. 32s       -
Chain of Thought  GPT-4           0.76  0.85        0.87                       -  $38.62
                  GPT-3.5 Turbo   0.56  0.69        0.77                       -   $1.26
                  Mistral 7B      0.53  0.72        0.76           1 hr. 50 min.       -
   Logit Bias     GPT-4            0.8  0.89         0.9                       -  $12.52
                  GPT-3.5 Turbo   0.63  0.81        0.81                       -   $0.68
                  Mistral 7B      0.56  0.72        0.78              2 min. 33s       -
